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Abstract: We discuss two separate techniques for Kalman Filtering in the presence of state space equality constraints. We 
then prove that despite the lack of similarity in their formulations, under certain conditions, the two methods result in math- 
ematically equivalent constrained estimate structures. We conclude that the potential benefits of using equality constraints in 
Kalman Filtering often outweigh the computational costs, and as such, equality constraints, when present, should be enforced 
by way of one of these two methods. 
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1 Introduction 

Kalman Filtering [1] is a method to make real-time predic- 
tions for systems with some known dynamics. Traditionally, 
problems requiring Kalman Filtering have been complex and 
nonlinear. Many advances have been made in the direction 
of dealing with nonlinearities (e.g.. Extended Kalman Fil- 
ter [2], Unscented Kalman Filter [3]). These problems also 
tend to have inherent state space equality constraints (e.g., a 
fixed speed for a robotic arm) or even state space inequality 
constraints (e.g., maximum attainable speed of a motor). In 
the past, less interest has been generated towards constrained 
Kalman Filtering, partly because constraints can be difficult 
to model. As a result, equality constraints are often neglected 
in standard Kalman Filtering applications. However, the ben- 
efits of incorporating constraints can outweigh the computa- 
tional costs associated with constraining the estimate (e.g., 
the constrained estimate can be quite different from the un- 
constrained estimate and the error covariance matrix can only 
get tighter since we are adding information to our model). 
We discuss two distinct approaches to generalizing an equal- 
ity constrained Kalman Filter. The first approach is to aug- 
ment the measurement space of the filter with the equality 
constraints (i.e., as perfect noise-free measurements) at each 
iteration. The second approach is to find the unconstrained 
estimate from a Kalman Filter and project it down to the 
equality constrained space. Both of these approaches have 
appeared in the literature in the past (e.g., [4], [5]). We will 
then show that, under certain conditions, the first approach 
and the second approach actually yield the same analytical 
distribution for the constrained estimate despite the differing 
formulations. There is a third well-known approach to this 
problem, which is to reduce the state space by the dimension 
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of the constraints. This can lead to a state space that does not 
carry much meaning to the engineer. This approach, while 
valid, is not discussed in this paper. 

Analogous to the way a Kalman Filter can be extended to 
solve problems containing non-linearities in the dynamics 
using an Extended Kalman Filter by linearizing locally (or 
by using an Unscented Kalman Filter), linear equality con- 
strained filtering can similarly be extended to problems with 
nonlinear constraints by linearizing locally (or by way of an- 
other scheme). The accuracy achieved by methods dealing 
with nonlinear constraints will naturally depend on the struc- 
ture and curvature of the nonlinear function itself. 
Equality constrained Kalman Filtering also appears as a sub- 
routine in the more general framework of inequality con- 
strained Kalman Filtering. One method for extending an 
equality constrained filter to an inequality constrained filter 
would be to use an active set method (as in [6]). 

2 Kalman Filter 

A discrete-time Kalman Filter attempts to find the best run- 
ning estimate for a recursive system governed by the follow- 
ing model: 

Xk = Fk,k-lXk-l + Uk,k-1: Uk,k-1 ~ ^^(0, Qk,k-l) 

(1) 

Zk HkXk +Vk, N{Q, Rk) (2) 

Here Xk represents the true state of the underlying systerrjand 
Fk^k-i is the matrix that describes the transition dynamics of 
the system from Xk-i to Xk- The measurement made by the 
observer is denoted Zk, and Hk is the matrix that transforms 
a vector from the state space into the appropriate vector in the 

The subscript k means for the fc-th time step. 



measurement space. The noise terms u^.k-i and Vk encom- 
pass known and unknown errors in Fk.k-i and Hk and are 
normally distributed with mean and variances Qk,k-i and 
Rk, respectively. At each iteration, the Kalman Filter makes 
a state prediction for Xk, which we denote by Xk\k-i- We use 
the notation k\k — 1 since we will only use measurements 
provided until time-step fc — 1 in order to make the prediction 
at time-step k. The state prediction error x^i^_i is defined as 
the difference between the true state and the state prediction, 
as below. 



Xk\k-i — Xk — Xm^^i 



(3) 



The covariance structure for the expected error on the state 
prediction is defined as the expectation of the outer product 
of the state prediction error. We call this covariance structure 
the error covariance prediction and denote it Puk-i- 



Pi 



k\k-l 



E 



[Xk\k^l) [Xk\k^l) 



(4) 



In addition, the filter will provide a state estimate for Xk, 
given all the measurements provided up to and including time 
step k. We denote these estimates by 5:^1^. We similarly de- 
fine the state estimate error Xk\k as below. 



Xk\k — Xk — Xfeifc 



(5) 



The expectation of the outer product of the state estimate er- 
ror represents the covariance structure of the expected errors 
on the state estimate, which we call the updated error covari- 



ance and denote Pi 



k\k- 



Pi 



k\k 



E 



(^fc|fc) {Xk\k)' 



(6) 



At time-step fc, we can make a prediction for the underly- 
ing state of the system by allowing the state to transition 
forward using our model for the dynamics and noting that 
E [ufe^fe-i] = 0. This serves as our state prediction. 



Xk\k-1 — Fk,k-lXk-l\k-l 



(7) 



If we expand the expectation in Equation (|4|l, we have the 
following equation for the error covariance prediction]] 



-Pfe|fe-1 — Pk,k-lPk-l\k-lFLk-l + Qk,k-1 



(8) 



We can transform our state prediction into the measurement 
space, which is a prediction for the measurement we now ex- 
pect to observe. 



Zk\k-1 — HkXk\k- 



(9) 



The difference between the observed measurement and our 
predicted measurement is the measurement residual, which 
we are hoping to minimize in this algorithm. 



We use the prime notation on a vector or a matrix to denote its transpose 
tlirougliout tliis paper. 



Vk = Zk- Zk\k-l (10) 

We can also calculate the associated covariance for the mea- 
surement residual, which is the expectation of the outer prod- 
uct of the measurement residual with itself, E [vk i^'f.] ■ We call 
this the measurement residual covariance. 



Rk 



(11) 



Sk — HkPk\k-lHk 

We now calculate the Kalman Gain, which lies at the heart of 
the Kalman Filter This tells us how much we prefer our new 
observed measurement over our state prediction. 



Kk = Pkik-iH'kSj. ^ 



(12) 



Using the Kalman Gain and measurement residual, we update 
the state estimate. If we look carefully at the following equa- 
tion, we are taking a weighted sum of our state prediction 
with the Kalman Gain multiplied by the measurement resid- 
ual, so the Kalman Gain is telling us how much to 'weigh in' 
information contained in the new measurement. We calculate 
the updated state estimate by 



Xk\k = Xk\k-i + KkVk 



(13) 



Finally, we calculate the updated error covariance by expand- 
ing the outer product in Equation ^\ 



Pk\k = {I - KkHk) Pk\k-i 



(14) 



The covariance matrices in the Kalman Filter provide us with 
a measure for uncertainty in our predictions and updated state 
estimate. This is a very important feature for the various 
applications of filtering since we then know how much to 
trust our predictions and estimates. Also, since the method 
is recursive, we need to provide an initial covariance that is 
large enough to contain the initial state estimate to ensure 
comprehendible performance. For a more detailed discus- 
sion of Kalman Filtering, we refer the reader to the following 
book [2]. 

3 Incorporating Equality Constraints by Aug- 
menting the Measurement Space 

The first method for incorporating equality constraints into a 
Kalman Filter is to 'observe' the constraints at every iteration 
as noise-free measurements. To illustrate this, we augment 
linear constraints to the system shown in Equations ([T]) and 
(|2]) as measurements with variance. We will define the con- 
straints in this formulation as DkXk ~ 5k\ Thus, we can 
re-write the system. 



Tlie / in Equation )14t represents tlie identity matrix of the appropriate 
dimension. Throughout the remainder of this paper, we will continue to use 
/ in the same fashion. 

We assume these constraints are well defined throughout this paper - 
i.e., no constraints conflict with one another to cause a null solution and no 
constraints are repeated. More specifically, we assume has full row rank. 
Note that under these conditions if D^. was a square matrix, the constraints 
would completely determine the state. 



Uk^k-i ~ N{Q, Qk,k-i) 
(15) 



(16) 



Here we use the superscript D notation to denote the new 
filter with the equality constraints. The next three equations 
show the construction of the augmentation in the measure- 
ment space. 



Zk 

Sk 

Hk 
Dk 



Rk 




(17) 



(18) 



(19) 



The augmented state now forces Dkx^ to be equal to 5k ex- 
actly (i.e., with no noise term) at every iteration! Let us now 
expand the equations for the Kalman Filter prediction and 
update to gain a stronger understanding of how the filter has 
changed. 

The state prediction from Equation (|7|i becomes the follow- 
ing. 



Fk.k-iXL 



(20) 



The error covariance prediction from Equation ^ becomes 
the following. 

Pk\k-1 = Fk,k-lPk-i\k-lFk,k^l + Qk,k-1 (21) 

The measurement prediction from Equation (|9]) can then be 
written in the following form. 



^fe fe-1 — ^k -^fe fe-1 



Hkx^\k- 
DkX^lk- 



(22a) 
(22b) 



Similarly, we can express the measurement residual from 
Equation ( fTOl l in the following manner. 



D _ ~D 
^k ^fe|fe-l 



Zk 

Sk 



^l^^k\k-l 



(23a) 
(23b) 



We expand the measurement residual covariance from Equa- 
tion ( fTTT i below. 



With is constructed in the same fashion as Xf. 



Sk = ^fc'-Pfcffc-l {Hk) + Rk 
= Pk\k-l {H'k ^'k\ 

HkP^k-l^'k + Rk HkPl^\k_^D'^. 



DkPSk-.Hi 



Rk 
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The Kalman Gain can now be written as below. 



In order to further expand this term, we denote [Sj: 
the following block matrix form. 



(24a) 
(24b) 

(24c) 



(25) 

-1 . 
m 



(sF 



k Jd 



(26) 



We then expand the Kalman Gain in terms of the block struc- 
ture of Equation ( |26] l. 



K^ = P^lk-i[H'k 



(27a) 



pD TTl pD p)l 

^k\k-l^k ^klk-l^k 



iSk)c iSk)d 

iSk)a iSk')b 

(27b) 
(27c) 



Here, we've used the following two terms to shorten the ex- 
pression above. 

(i^f )^ = P^\,_,H', (5f + P^,^,D', (S^)-' (28a) 

{K^, - Pkl-iH'k (S^)-' + P^\k-iD'k {S^T (28b) 

Furthermore, the updated state estimate from Equation ( fTsT i 
takes the following form. 



k\k 



(29) 



And the updated error covariance from Equation (fl4] i changes 
in the following way. 



Pk'^k = iI-K^H^)PF 



k\k-l 



(30) 



Methods using augmentation in Kalman Filters have ap- 
peared for different applications in the past (e.g., Fixed- 
Point Smoothing [7], Bias Detection [8]). In order to gain 
a stronger understanding of the effects of augmentation in 
Kalman Filters, it can be helpful to read and understand these 
methods, as well. 



3.1 Improvement gained over an Unconstrained Filter 

For a given iteration, we are interested in the improvement 
gained by using this method over a method that does not in- 
corporate equahty constraints. In order to do so, we would 
like to find the constrained estimated a;^^ in terms of the un- 
constrained estimate ij-n, (and similarly the constrained error 
covariance matrix in terms of the unconstrained error 
covariance matrix Pk\k)- Suppose we start with the same pre- 
vious estimate and error covariance matrix for both filters. 



''fc-llfc-l 



2;fc-l|fc-l 



(31) 



El 



Sk 

DkPk\k- 



DkPk\k- 

HkPk\k-iD'^. 
DkPk\k-iDl 



(37a) 



(37b) 



As before, we are interested in finding (S*^) in a block 
structure. We follow the methodology described in Appendix 
|A]and apply it to Equation (l37] lll 



pD _ p 



|fc-i 



(32) 



Thus, we consider the benefit of using the new constrained 
filter over the unconstrained Kalman Filter gained in one it- 
eration. We can re-write all the constrained filter's equations 
in terms of the corresponding equations of the unconstrained 
Kalman Filter 

Starting with Equation (|20] |. we find that the state prediction 
remains the same over one iteration. 



~ D TP 

^k\k-l — ^fc.fc-l^-'fc-llfc-l 

m . 

— Xk\k-i 



(33a) 
(33b) 



Similarly, we find the error covariance prediction from Equa- 
tion (l2n i remains the same over one iteration. 



PEk-i ^ FkM-iPk-i\k-iFk,k-i + Qk,k-i (34a) 
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Pk\k-1 



(34b) 



(S^):'^ Sz' + Sz'HkPk\k-.D', 

{DkPk\k-iD'k - DkPk\k-iH'kSk'Hk 
Pk\k-iD'ky^ DkPk\k-iH'kS,:' (38a) 

^ ^k^ + ^k ^HkPk\k-iD'k 

{DkPkikD'ky' DkPk\k-iH'kS^' (38b) 
I Sy + K'f,D'yDkPk\kD'ky^ DkKk (38c) 

In a similar manner using Equations (fTTT i. (|57] |. and (l58T l, we 
arrive at the following remaining terms in the block structure. 



{S^y' ^-KiD',{DkPkikD'k) ' 



(39) 



The measurement prediction from Equation (l22l l is then mod- 
ified as below. 



St 



{DkPk\kD'k) 'DkKk 



(40) 



^k\k-l — 
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HkXk\k-i 

DkXk\k-l 
Zk\k-l 

DkXk\k~i 



(35a) 
(35b) 



We can also easily modify the measurement residual from 
Equation ( l23T l. 



Ey'^{DkPk\kD'ky' 



(41) 



Applying this to Equations (|28al l. we can find the first part of 
the Kalman Gain. 



.D 



m 



Zk — HkXk\k-l 

Sk - DkXk\k-i 

Vk 

5k - DkXk\k-i 



(36a) 
(36b) 



And the measurement residual covariance from Equation ( |24] | 
can then be modified as well. 



When finding {S°'^ 



J as described above, we know that A as defined 
in AppendixlAlwill be nonsingular since it represents the measurement resid- 
ual covariance 5^ . If tliis matrix was singular, this would mean there exists 
no uncertainty in our measurement prediction or in our measurement, and 
thus there would be no ability to filter Similarly, we know that J as defined 
in Appendix IaI must also be nonsingular, which is equal to DkPk\k~i^'k 
(see Equation B7t ). This term projects the predicted en'or covaiiance down 
to the constrained space. For well defined constraints (as described earlier), 
this will never be singular - it will have the same rank as Dj. . 



(1},(40) 



(42a) 



DkKk 



Pk\k-iD'k{DkPk\kD'k) 'DkKk 

(42b) 



01 



Kk " iPk\k-i - Pk\k^iH'kK'k) (42c) 
D'k{DkPk\kD'ky' DkKk (42d) 

1* Kk- Pk\kD'k {DkPk\kD'ky' DkKk 

(42e) 

Following similar steps using Equations (|32| i. ( [39] l, PTt . and 
Jl, we can arrive at the other part of the Kalman Gain. 



{K^)^^Pk\kD'k{DkPk\kD'k) ' (43) 



We can then substitute our expressions for K^ directly into 



Equation (|29] l to find a simplified form of the updated state 
estimate. 



.n m 

^k\k — 



(27),(36} 



Xk\k-i+K^v^ (44a) 

Xk\k~i + [Kk)^ Vk 
+ {K^),{5k-DkXk\k-i) (44b) 



Xk\k-i + KkVk 
- Pk\kD'k iDkPk\kD'k)~' DkKkVk 
+ Pk\kD'k{DkPk\kD'ky' 

{5k - DkXk\k-i) (44c) 

^ Xk\k~ PklkD'k {DkPk\kD'ky' Dk 

{xk\k ~ S:k\k-i) 
+ Pk\kD'k{DkPk\kD'ky' 

(4 - DkXk\k-i) (44d) 
Xk\k - PklkD'k {DkPk\kD'ky' 

{DkXk\k - Sk) (44e) 



Similarly, we can expand the updated error covariance in 
Equation ( [30] l. 



^k\k — 



{l-{K^)^Hk-{K^),Dk)Pk\k 



(45a) 



•M) ^l-KkHk + Pk\kD'k{DkPk\kD'k) 'd 
KkHk - PklkD'k {DkPkikD'ky' D 



(45b) 

k 



Pi 



k\k-l 



(45c) 



{I - KkHk) Pkik-i ' PklkD'k 
{DkPk\kD'ky' Dk {I - KkHk) Pkik-i 



(45d) 



-Pfclfc - PklkD'k {DkPk\kD'k) ' i^fcP; 



k-rk\k 



(45e) 



Equations (|44] | and {45[ give us the improvement gained 
over an unconstrained Kalman Filter in a single iteration of 
the augmentation approach to constrained Kalman Filtering. 
We see that the covariance matrix can only get tighter since 
we are subtracting a positive semi-definite matrix from P^k 
above. 

4 Incorporating Equality Constraints by Project- 
ing tiie Unconstrained Estimate 

The second approach to equality constrained Kalman Fitler- 
ing is to run an unconstrained Kalman Filter and to project 
the estimate down to the constrained space at each iteration. 
We can then feed the new constrained estimate into the un- 
constrained Kalman Filter and continue this process. Such a 
method can be described by the following minimization prob- 
lem for a given time-step k, where i^^. is the constrained es- 
timate, Xk\k is the unconstrained estimate from the Kalman 
Filter equations, and Wk is any positive definite symmetric 
weighting matrix. 



^klk = argmm 



ijn|(a; - Xk\k)' Wk {x - Xk\k) ■ DkX = 4| 

(46) 

The best constrained estimate is then given by 

s^m = -ifcifc - wyD'k {DkwyD'ky' {DkXkik - 4) 

(47) 

If we choose Wk — P^l^ we obtain the same solution as 
Equation ( |44] |. This is not obvious considering the differ- 
ing approaches. The updated error covariance under this as- 
sumption will be the same as Equation ( |45] | since Pf 



E 



{^k - X^ik) [xk - X^\k) 



klk 



and = i^^. Further 



this choice of Wk is the most natural since it best describes 
the uncertainty in the state. 



5 Dealing with Nonlinearities 

Thus far, in the Kalman Filter we have dealt with linear 
models and constraints. A number of methods have been 
proposed to handle nonlinear constraints. In this paper, we 
will focus on the most widely known of these, the Extended 
Kalman Filter Let's re-write the discrete unconstrained 
Kalman Filtering problem from Equations (dJ and ^ below, 
incorporating nonlinear models. 

Xk = fk,k-i {xk-i) + Uk,k-i, Uk,k~i ^ N{0, Qk.k^i) 

(48) 

Zk = hk{xk)+Vk, Vk-^N{0,Rk) (49) 

In the above equations, we see that the transition matrix 
Ffe fc_i has been replaced by the nonlinear vector-valued 
function/fc (•), and similarly, the matrix Hk, which trans- 
forms a vector from the state space into the measurement 
space, has been replaced by the nonlinear vector-valued func- 
tion hk (•). The method proposed by the Extended Kalman 
Filter is to linearize the nonlinearities about the current state 
prediction (or estimate). That is, we choose Fk.k-i as the 
Jacobian of fk,k~i evaluated at Xk-i\k-i, and Hk as the 
Jacobian of hk evaluated at Xk\k-i and proceed as in the 
linear Kalman Filter of Section |2l Numerical accuracy of 
these methods tends to depend heavily on the nonlinear func- 
tions. If we have linear equality constraints but a nonlinear 
/fc.fc-i (•) and hk (•), we can adapt the Extended Kalman Fil- 
ter to fit into the framework of the methods described in Sec- 
tions [3] and 2] We have chosen to omit the specific equations, 
as the extension should be apparent. 

5.1 Nonlinear Equality Constraints 

Since equality constraints we model are often times nonlin- 
ear, it is important to make an extension to nonlinear equality 
constrained Kalman Filtering for the two methods discussed 
thus far We replace the linear equality constraint on the state 
space by the following nonlinear constraint dk (xk) — Sk, 
where (•) is a vector- valued function. The method based 
on augmenting the constraints presented in Section |3] is triv- 
ially extended by using an Extended Kalman Filter before - 
i.e., we choose Dk in Equation (fTsT l as the Jacobian of dk 
evaluated at xf^i^_i- 

Incorporating nonlinear equality constraints into the projec- 
tion method described in Section |4] requires a more explicit 
change. If we linearize our constraint, dk (xk) ~ Sk, about 
the current state prediction x^i._i, we have the following. 

dk {x^\k-i) + Dk (xk -x^ik-i) ~ 4 (50) 

We can also do a midpoint approximation to find _Ffe by evaluating 
the Jacobian atxj._in,_i and xm._i and then taking the component- wise 
mean. This has the disadvantage that it is twice as expensive for finding 
-Ffc but it should be a much closer approximation. We use this approx- 
imation for the Extended Kalman Filter example later in this paper 



Here Dk is defined as the Jacobian of dk evaluated at 
similar to before. This indicates then, that the nonlinear con- 
straint we would like to model can be approximated by the 
following linear constraint 

DkXk ^ Sk + DkX^\k-i - dk {x^\k-i) (51) 

Then our projected state is given as in Section 21 with Dk 
defined as above, and Sk replaced by the right hand side of 
Equation dSTT ). 

6 Discussion of Methods 

Thus far, we have discussed two different methods for incor- 
porating equality constraints in a Kalman Filter, and we have 
shown that both are mathematically equivalent under the as- 
sumption that the weighting matrix Wk chosen in Section|4]is 
chosen to be P^l- As such, the projection method is a more 
general formulation of the augmentation method described in 
Section [3] On the other hand, the augmentation method pro- 
vides a trivial extension to soft equality constrained Kalman 
Filtering by increasing the noise modeled in i?^ to reflect 
how soft the constraint should be. 

In implementations, there are some subtle differences. For 
instance, the first method requires a minimal adjustment to 
codes for an existing Kalman Filter or an Extended Kalman 
Filter - i.e., we can pass in the augmented matrices and get 
the constrained estimate. This is especially advantageous for 
codes that use variations of the standard linear Kalman Filter 
(e.g., an Unscented Kalman Filter). On the other hand, the 
second method will require less memory and computation, 
which can significantly speed up the filtering when the state 
space and constraint space are both large. The second method 
does not store or compute the 'cross-correlation' terms of 
Equation (IJTI i. which are most likely of little interest to the 
engineer. 

There is another more transparent difference between these 
two methods. In implementations, we are bound to receive 
numerical round-off error While these two methods are 
mathematically equivalent, we will not see the exact same re- 
sult. The round off error that causes the most problem occurs 
when the updated error covariance P^^, or P^^, lose symme- 
try or positive definiteness. A way around this is to use the 
Joseph Form of the updated error covariance (see [2]) - this 
will be discussed further in another publication. 

7 Conclusions 

We've presented two approaches for incorporating state space 
equality constraints into a Kalman Filter and shown that both 
result in the same estimate structure under certain conditions. 
The projection method should prove to be computationally 
faster and is also a generalization that allows different weight- 
ing matrices when projecting the estimate. However, the aug- 
mentation method may prove easier in implementations since 
we can use an existing Kalman Filter without any code mod- 
ifications. We can also easily extend the latter to enforce 



soft equality constraints, where we allow the constraint to be 
slightly blurred by adding a proportionate amount of noise 
i?f (Equation (O). 

A An analytic block representation for (5*1^) ^ 

as defined in Equation ( |24] | is a symmetric saddle point 
matrix of the form A/5 pm below. 



B.3 Third Identity 



-ffe|fe-l — Pk\k-lHl.K'f. 
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k\k 



(59a) 
(59b) 
(59c) 

(59d) 
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SPM 



A B'' 

B -C 



(52) 



In the case that A is nonsingular and the Schur complement 
J = - {C + BA-^B') is also nonsingular in the above 
equation, it is known that the inverse of this saddle point ma- 
trix can be expressed analytically by the following equation 
(see e.g., [9]). 



M 



SPM 



A- 



^ A-^B'J-^BA-^ 
-J-^BA-^ 



-A-^B',]-^ 



(53) 

For , we have the following equations to fit the block 
structure of Equation ( |52] | (see Equation (|24]|). 



A - HkPkik-iH'k + Rk 



-iH'k 



C 



3-D 

k\k- 

-DkP^k-iD'k 



(54) 
(55) 
(56) 



Under the assumption that both A and J are nonsingular, we 



can make some substitutions and express (S* 
the notation of Equation 

B Some Identities 



following 



The following are identities that will prove useful in some 
of the earlier derivations of Section [3] The matrices in these 
identities are used as defined in Sections |2] and [3] 



B.l First Identity 

DkPk\k-iD'k - DkPk\k-iHkSf. ^ HkPk\k-iD'k 

- DkPk\k-iD'i, - DkKkHkPk\k-iD'k 
Dk {I - KkHk) Pk\k~iD'k 



DkPklkD'k 



(57a) 

(57b) 
(57c) 

(57d) 



B.l Second Identity 

In the first step below, we make use of the symmetry of 
Pfc|fc_i and S~^. 



Again, we've made use of the symmetry of Pk\k-i between 
Equations ( |59bt and ( |59ct . 
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S-^HkPk\k-iD'k{DkPk\kD'k) ^ DkPkik-iH'kS-' (58a) 

= {Pk\k-lH'kSk ^) 



D'k [DkPk\kD'k) 



DkPk\k-iH'kSk' 
1 K'kD'k{DkPk\kD'ky' DkKk 



(58b) 
(58c) 



